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The disorder and a simple convex measure of complexity 
are studied for rank ordered power law distributions, indica- 
tive of criticality, in the case where the total number of ranks 
is large. It is found that a power law distribution may pro- 
duce a high level of complexity only for a restricted range 
of system size (as measured by the total number of ranks), 
with the range depending on the exponent of the distribu- 
tion. Similar results are found for disorder. Self-organized 
criticality thus does not guarantee a high level of complex- 
ity, and when complexity does arise, it is self-organized itself 
only if self-organized criticality is reached at an appropriate 
system size. 
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Self-organized criticality [jlj has been maintained to be 
"so far the only known general mechanism to generate 
complexity" S. Actually, self-organized criticality says 
nothing about complexity itself directly. Rather, it can 
be taken as defined by two properties. The first is that 
of the critical state, indicated by a power law probability 
distribution. The second, self-organization, is that the 
critical state is reached spontaneously, without the influ- 
ence of any external agent, to set parameter values for 
example. The question asked here is whether a power 
law distribution necessarily implies complexity. 

Power law distributions usually occur in one of two 
forms. In the first the probability p(m) of an event of 
magnitude m is expressed as a power of the magnitude 
itself: p(m) cx 1/m 7 , where 7 is a nonnegative constant. 
Examples include the Gutenberg-Richter law relating the 
frequency of earthquakes to the energy released [3,I|, 
fluctuations in the stock and commodities markets [5,3|, 
and the number of extinctions throughout biological evo- 
lution . It should be noted that some examples are 
not uncontroversial; for example, there are alternative 
explanations for the frequencies of biological extinctions 

In the second common form of power law distributions 
the distributions are rank (r) ordered. The most frequent 
or probable event or state has rank 1; the second most 
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probable, rank 2; etc. The distribution is then written 
p(r) cx 1/r 7 . The first well known example was Zipf 's law 
for the distribution of word frequencies in the English lan- 
guage |l(J ; others are the distribution of city populations 
and various aspects of the "web" [ pdp2] | . Since the rank 
ordered form of power law distributions is the marginally 
simpler one, it will be used in the following. 

There is a plethora of proposals for complexity mea- 
sures in the literature, each trying to capture one or more 
aspects of what we mean when we say that something 
is complex. Most current measures may be assigned to 
one of two categories [p~3| , Fig. 0, (p|. In the first, 
complexity increases monotonically with disorder. In the 
second, complexity shows a convex dependence on disor- 
der, vanishing at minimum and maximum disorder, and 
obtaining a maximum at an intermediate level of disor- 
der. 

It is important to recognize that entropy is not neces- 
sarily a good measure for disorder, e.g. when the number 
of states available to a system can change. For this rea- 
son Landsberg [p~7| p~9|| proposed that disorder A be taken 
as 



A = S/S n 
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where pi is the probability of state i of N possible states, 
and S is therefore the information entropy. S max is the 
appropriate maximum entropy. This measure for disor- 
der has been applied to problems ranging from cosmol- 
ogy jl9| to biology ||(J , and can be generalized easily J21]] 
to measures based on higher order Renyi entropies j22|, 



which are related to multifractals |23 
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Based on the Landsberg "disorder" |25[| we have pro- 
posed a "simple measure of complexity" |^l|,^6| whose 
behavior encompasses both the monotonic and convex 
categories: 
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When a > and (3 vanishes, T a p is a monotonic com- 
plexity measure; when a, ft > Q, r Q ^ is a convex measure. 
Since the results here will not depend on the particular 
dependence of complexity on disorder, but rather only on 
whether the dependence is monotonic or convex, in the 
following only the simplest cases will be considered: 
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For convenience these will be referred to simply as "dis- 
order" and "complexity", respectively. 

It is important to understand that A is not equivalent 
to the entropy S and that, therefore, T is not simply a 
function of entropy. To say that T is a function of S alone 
is to misunderstand the reason for introducing A as an 
alternative to entropy as a measure of disorder in the first 
place [p7|-^9[ . As S varies, S max will in general also vary, 
but not proportionally to S, so that A will in general 
change in a manner distinct from the variation in S. A 
may even decrease as S increases. Both S and S max will 
generally change (nonproportionally) in several scenarios, 
including changes in system size, changes in the level of 
fine graining and changes in boundary conditions. More- 
over, there may be several choices for S and S max for a 
given system. Which ones are appropriate will depend on 
the questions being addressed. In the simplest cases S max 
can be taken to be the entropy of the equiprobable (all 
Pi = 1/-/V) distribution, hxN. For nonequilibrium sys- 
tems, it may be more appropriate to take S max to be the 
entropy of the corresponding equilibrium system, i.e. the 
equilibrium system with the same total energy, number 
of particles, etc. | p7[ . Even for a simple one-dimensional 
Ising spin system, several entropies and therefore sev- 
eral "disorders" can be introduced |2(],|3(| . Furthermore, 
multiple choices for S and S max imply multiple A's and 
multiple T's. When one considers that T calculated from 
one A can be investigated as a function of another "dis- 
order" , one recognizes that eqs. allow for a multi- 
plicity of disorder-complexity relations. In short, eq. (j^) 
is the definition of T a p and does not uniquely determine 
its dependence on A. For a discussion of these points 
and eq. (0) as a measure of complexity see |2§|-|30|] . 

For the distributions studied here only one S max will be 
investigated, that of the equiprobable distribution, and T 
is determined by A. This is appropriate for distinguish- 
ing between complexity measures which increase mono- 
tonically with disorder and those which show a convex 
dependence on disorder, one purpose of this study. 

The entropy, "disorder" and "complexity" of the rank 
ordered power law distribution, p(r) oc 1/r 7 , with maxi- 
mum rank R are now 

R R 
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s = -J^p(r) ln P( r ) = ins + ( 7 /a) J2 ( lnr ) A" 7 . ( 4 ) 
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R may have different interpretations. The most straight- 
forward is that of R as the maximum observed rank. R 
may also be taken to be the size of the system, in the 
sense that a larger system has more states, i.e. more 



ranks. Finally, R may be interpreted as a measure of the 
extent of fine graining. Examples of power law distribu- 
tions are often presented as histograms, e.g. the number 
of biological extinctions < 10%, between 10 and 20%, . . . 
|^| . If the distribution is more refined, say < 1%, be- 
tween 1 and 2%, . . . , then R obviously increases. In the 
limit R ~ * oo we have the fine grained or thermodynamic 
limit. 

Since the latter limit is of particular importance, I will 
now consider the case of large R. Replacing sums by 
integrals, we have (3l) 
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Smax = In (R - 1) . 




The dependence of "disorder" and "complexity" on R 
is shown in Fig. 0. The first point to note is 
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In the fine grained limit, the system is either completely 
disordered (7 < 1) or completely ordered (7 > 1), with 
the one exception of 7 = 1, where the system is half 
maximally disordered (half maximally ordered). In the 
thermodynamic limit "complexity" vanishes except for 
the special case 7 = 1, where "complexity" has its max- 
imum possible value (with the choice of a = = 1). In 
this limit self-organized criticality does not imply "com- 
plexity" in general: "complexity" itself vanishes except 
for 7 = 1, and "disorder" vanishes except for 7 < 1. 

For R large, but R < 00, significant points to be noted 
are: 

for 7 < 1 , A goes through a relative minimum and 
r through a relative maximum as R increases; 

for 7 > 1, A decreases monotonically with R, and 
r first increases to its absolute maximum to then 
vanish in the limit R — > 00. 

Values of 7 other than 1 may yield nonvanishing values 
of "complexity" , but only for some range of intermediate 
values of R. It should be noted that these results are not 
limited to the particular forms for disorder and complex- 
ity used here. Qualitatively the complexity results apply 
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for all convex complexity measures, since they all van- 
ish for minimum and maximum disorder. Similarly, the 
disorder results are valid qualitatively for all monotonic 
complexity measures. 

Even if the power law probability distribution of self- 
organized criticality does lead to a high level of "complex- 
ity", this does not imply that the "complexity" itself is 
self-organized. For self-organized complexity, the system 
must not only evolve to a power law probability distribu- 
tion spontaneously, it must also do so so that 7 is exactly 
1 in the limit R — > 00. Or, if R is large but finite, the 
system must spontaneously evolve to a size for which the 
complexity is large for the operative value of 7. Thus 
self-organized complexity requires much more stringent 
conditions than self-organized criticality. Whether the 
many systems which are known to be examples of self- 
organized criticality also show self-organized complexity 
remains to be seen. 

Two additional points — (1) Mandelbrot's ]|^] find- 
ing, that a monkey pounding on a typewriter at ran- 
dom produces a rank ordered power law distribution for 
the "words" typed, is consistent with the result of max- 
imum "disorder" and vanishing "complexity" in the fine 
grained limit for 7 < 1. (2) Bak [0 alludes to the "blind 
watchmaker" argument of Dawkins |33|. This is essen- 
tially an anti-vitalist argument, namely that the order 
and complexity produced by evolution apparent to us do 
not require the intervention of an external agent, i.e. "di- 
vine" intervention. In the case of self-organized criticality 
the argument is that nature can produce criticality and 
therefore complexity without the intervention of an ex- 
ternal agent. However, self-organized criticality produces 
a high level of "complexity" in the thermodynamic limit 
only for 7 = 1, or for R large but finite, only for cer- 
tain system sizes. For the "blind watchmaker" argument 
to apply to "complexity" , one must show not only that 
criticality is reached in a self-organized fashion but also 
that it is reached at an appropriate system size and 7. 
Otherwise, if the system size necessary for a high level 
of "complexity" is not reached spontaneously but must 
be set by an outside agent, the "watchmaker" must have 
sufficient visual acuity to do so. 
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FIG. 1. Classification of complexity measures based on de- 
pendence on disorder. Left: complexity increases monotoni- 
cally with disorder; right: complexity displays a convex de- 
pendence on disorder. 

FIG. 2. The dependence of "disorder" and "complexity" 
on the maximum rank R. The curves are labeled with the 
values of the exponent 7. 
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